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ABSTRACT 


A  general  survey  is  undertaken  of  the  techniques  used 
in  determining  loss  functions  to  be  minimized  for  the  purpose 
of  finding  optimal  (s,S)  values  in  the  Arrow,  Harris,  and 
Marschak  dynamic  inventory  modelo  A  brief  discussion  of  the 
cost  functions  and  the  aspects  of  demand,  backlogsing,  lag 
time,  and  discount  rate  are  presented  in  the  interest  of 
better  understanding  of  their  use  in  the  real  world0  Analytic 
gdutions  to  the  model  have  been  derived  by  two  different, 
but  related,  methods  involving  stationary  costs0  The  first 
method  involves  direct  use  of  the  cost  functions  in  a 
Markov  process  to  arrive  at  an  integral  equation  of  renewal 
which  is  developed  into  a  stationary  loss  function  by  an 
Abelian  limit  theorem.  The  second  method  involves  the 
determination  of  the  stationary  distribution  of  stock  level 
through  renewal  theory  ;  the  loss  function  for  a  represent¬ 
ative  period  is  brought  into  the  computations  independently 
in  determining  the  expected  loss  with  respect  to  the 
stationary  distribution  of  stock  level.  The  two  methods 
produce  the  same  resulto 

A  digital  computer  simulation  of  the  Arrow,  Harris, 
and  Marschak  dynamic  model  has  been  outlined  by  M0  Geisler 
^2  j0  Some  highlights  of  Geisler’ s  work  have  been  reviewed 
here  0 
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PREFACE 


Inventory  control  organizations  of  the  Navy  have  con¬ 
tracted  for  numerous  studies  into  the  decision  problems 
involved  in  dynamic  inventory  for  the  multi-echelon  systems 
as  found  in  the  Navy.  Also,  a  contract  for  the  construction 
of  a  computerized  dynamic  model  was  first  let  in  early  1955 
to  the  Stanford  Research  Institute.  This  work  continues 
today  with  improvements  being  added  as  break-throughs  develop 
in  the  study  of  the  nature  of  complex  Navy  inventory  opera¬ 
tions.  Industry  has  no  parallel  in  complexity  and  magnitude,. 
Models  in  use  prior  to  the  early  part  of  1955  were  more 
applicable  to  reasonable-size  firms.  Consequently,  the 
boundaries  of  development  of  inventory  theory  are  now  being 
pushed  by  the  military  organization  in  keeping  with  the 

i 

need  for  greater  efficiency  and  economy.  The  magnitude  of 
the  difficulty  in  finding  models  that  closely  approximate 
the  military  inventory  management  problem  are  appreciated 

by  relatively  few.  The  optimization  of  buying,  allocating, 

'  / 

and  redistributing  based  on  complex  statistical  fluctuations 
in  demand,  order ■ arrival,  and  military  loss  due  to  shortage 

i 

in  a  multi-echelon  structure  of  centers  and  depots  is  an 

i 

almost  insurmountable  obstacle  to  solution  for  a  large 

«  , 

part  of  the  total  carried  inventory. 

i 

/ 

/  . 

The / exposition  presented  in  this  paper  has  been  kept 

h  / 

relatively  simple.  Its  purpose  is  to  illuminate  the  basic 

/  v  ! 


T 


concepts  of  the  most  simple  dynamic  inventory  problem  as 

t 

first  presented  by  Arrow,  Harris,  and  Marschak  and,  thereby, 
gain  sufficient  insight  for  proceeding  into  more  complex 
dynamic  models,. 

Source  material  for  this  paper  has  consisted  primarily 
of  references  [•*■]>[  ^] » [5  ]>  and  notes  taken  during  a  course 
of  instruction  in  logistics  given  by  Professor  Thomas  E* 
Oberbeck  at  the  United  States  Naval  Postgraduate  School. 

I  wish  to  express  my  gratitude  to  Professor  Oberbeck  for 
hlB  support  and  encouragement  and  to  my  wife,  Helen,  for 
her  loyal  devotion  to  the  typing  and  clerical  taskso 
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,v  1.  Introduction 

The  history  and  general  characteristics  of  the  inven¬ 
tory  problem  under  various  operating  conditions  have  been 
adequately  discussed  in  [l].  The  (s,S)  policy'1'  is  widely 
used  in  practice  and  has  been  subject  to  extensive  analyti¬ 
cal  study.  This  ordering  rule  is  simple  and  has  the  follow¬ 
ing  advantages:  (i)  considerable  intuitive  appeal,  (ii)  large 
amounts  of  data  available,  (iii)  a  certain  ease  of  proba¬ 
bilistic  computation  and  analysis  and  (iv)  existence  of 
analytic  proofs  as  to  its  optimality  under  a  wide  range  of 
conditions.  Note  that  there  are  two  approaches  to  the  inven¬ 
tory  problem.  One  is  to  choose  a  simple  policy  (e.g.  (s,S) 
type)  and  proceed  with  the  analysis  of  specific  (s,S)  policies, 
and  the  other  approach  is  solve  the  decision  problem  through 
determination  of  the  characteristic  of  the  optimal  ordering 
policy  which,  minimizes  or  maximizes  an  appropriate  objective 
function.  Finding  the  characteristic  of  the  optimal  policy  is 
very  difficult.  Thus  the  usual  approach  is  to  choose  the 
practical  and  sound  (s,S)  policy  and  then  proceed  to  find 
within  this  policy  class  a  specific  policy  which  minimizes 
the  expected  long  run  costs  (i.e.,  specific  values  of  s  andS) . 

Then  the  study  of  the  inventory  model  becomes  a  study  of  the 

\  • 

associated  stochastic  process  which  is  generally  a  Markov 
process  where  the  states  of  the  system  (current  stock  level) 
depend  on  the  past  only  through  the  present. 

■^Often  called  the  two-bin  policy. 
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The  Arrow,  Karris,  and  Marshak  dynamic  inventory  model 
(hereafter  called  the  AHM  Model)  is  the  generic  name  often 
siven  in  the  literature  to  identify  the  (s,S)  policy  model 
where  ordering  takes  place  at  the  beginning  of  the  period 
when  the  stock  level  is  less  than  the  level  s  (i.e.  y^<s) 
and  demand  is  identically  and  independently  distributed  in 
each  time  period.  There  may  or  may  not  be  a  specified 
delivery  lag.  In  this  thesis,  deliveries  will  be  assumed 
to  arrive  immediately  after  ceins  ordered.  It  is  assumed 
that  the  reader  is  familiar  with  the  AHM  dynamic  model  of 
reference  Some  simple  restrictions  on  the  cost  func¬ 

tions  (having  to  do  with  the  convexity  of  the  expected  values 
of  the  cost  functions)  according  to  Scarf  £  10 j  are  the  only 
restrictions  required  in  order  that  the  optimal  policy  for 
the  AHM  dynamic  model  be  of  the  (s,S)  type.  Thus  over  a 
wide  rang£  of  conditions  (including  any  demand  distribution 
functions),  there  can  be  confidence  in  using  (s,S)  policies. 
Sections  2  and  3  are  devoted  to  a  resume^  of  the  cost  functions 
and  other  input  factors  in  order  to  develop  a  better  under- 
standing  of  their  meaning  in  analysis  and  their  relationship 
to  the  real  world.  {  \ 
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2.  Cost  Functions 


The  inventory  problem  has  three  cost  functions  which 
can  have  four  forns  (linear,  convex,  concave,  or  mixed). 

a.  Ordering  Cost, 

Suppose  z  represents  the  amount  of  stock  to  be 
ordered  and  c  tne  cost  per  unit  ordered.  A  linear 
ordering  cost  Is  directly  proportional  to  the  amount 
ordered,  i.e.  c*z.  The  case  where  c(z)  is  concave 
is  a  common  situation  in  buying  since  this  means 
that  each  additional  item  costs  less.  A  special  case 
of  concavity  exists  when  c(z)  is  composed  of  c*z+K 
where  K  is  the  administrative  costs  of  processing  an 
order.  The  convex  case  is  unlikely  to  occur  since 
it  means  that  each  additional  item  costs  more.  The 
mixed  case  where  pieces  are  made  up  of  linear  and 
concave  portions  is  practical. 

b.  Storage  Cost. 

Usually  storage  costs  are  proportional  to  the 
size  of  stock  on  hand,  but  the  cost  may  increase  more 
rapidly  if  the  storehouse  capacity  is  exceeded  and 
additional  space  must  be  rented.  Storage  costs  may 
include  such  things  as  stock  maintenance,  storage 
rental,  stock  obsolescence  or  spoilage,  stock  repair, 

c.  Penalty  Cost. 

These  xcosts  arise  when  demand  exceeds  supply 


etc  . 
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as  opposed  to  storage  costs  which  arise  due  to 
supply  exceeding  demand.  The  form  of  the  penalty 
cost  function  varies  widely  since  so  many  conditions 
exist.  The  simplest  is  the  linear  case.  A  realistic 
case  for  industry  is  the  convex  function  since  a 
small  shortage  has  small  consequences  but  a  large 
shortage  produces  increasingly  greater  difficulties 
for  the  customers.  In  some  military  applications 
certain  items  directly  affect  the  mission  and  a  short- 
age  of  these  items  will  cause  failure  of  the  mission; 
consequently  the  shortage  function  could  be  considered 
a  positive  constant  when  a  shortage  develops  and  zero 
otherwise.  In  reality,  the  military  supply  items  vary 
in  importance  and  end-use.  This  is  why  a  military 
supply  system  is  hardput  to  define  the  military  essen¬ 
tiality  of  all  items.  So  far,  the  military  essential¬ 
ity  designation  has  been  applied  to  the  allowance  lists 
of  designated  submarines;  however  there  is  a  move  afoot 
to  expand  this  program  to  include  all  naval  vessels. 

The  obvious  difficulty7  in  this  project  lies  in  review¬ 
ing  and  updating  the  allowance  item  essentiality 
designation. 


k 


3.  Other  Factors* 


\ 


Inventories  are  held  for  the  ultimate  purpose  of 
satisfying  demand,  and  money  laid  out  for  orders  and  items 
of  inventory  will  not  be  returned  for  awhile.  The  alterna¬ 
tive  to  having  money  tied  up  in  inventory  is  to  have  it 
invested  in  securities,  bonds,  or  similar  instruments* 
Long-term  government  bonds  are  a  good  standard  for 
comparison  since  they  are  both  secure  and  yield  a  reason¬ 
able  return  of  \\%%  Lag  time  is  the  time  between  ordering 
and  receiving,  and  it  directly  affects  the  amount  of  stock 
to  be  carried.  Backlogeing  is  the  procedure  whereby  demands 
in  excess  of  stock  (unfilled  orders)  are  kept  on  the  books 
until  they  can  be  satisfied  thereby  giving  meaning  to 
negative  inventory  values, 
a.  Discount  Rate0 

A  return  of  $1.04  at  the  end  of  a  year  is  equiv¬ 
alent  to  $1.00  invested  today  in  inventory.  The  discount 
rate  is  OC=  l/l«04  which  is  an  equivalent  way  of  consider¬ 
ing  the  comparative  return.  Thus  a  $1.00  return  in  a  year 
is  equivalent  to  OC  dollars  invested  in  inventory  today* 
Considering  that  the  $1.00  return  on  investment  is  re¬ 
invested  each  year  or  remains  invested  at  k.%,  then  CX, 

2  o 

*  represents  the  discount  rate  for 
$lo00  after  one  year,  two  years,  three  years,  etc* 

(i*e.  an  is  the  present  value  of  $1.00  which  has 
been  tied-up  in  inventory  during  the  n*'*1  period). 
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■  \ 


For  all  practical  purposes  (X~  1  when  the  time  horizon 
is  short. 

b  *  Demand  » 

Demand  is  usually  assumed  to  be  independent 
of  the  decision  makers  control;  however,  this  is  not 
always  the  case  in  industry  (e.g.  demand  is  directly 
related  to  advertising) 0  In  military  inventory  it  seems 
safe  to  assume  that  demand  is  independent  of  the  decision 
maker.  Demand  may  be  regarded  as  deterministic  in  future 
time  periods.  However,  it  is  more  realistic  to  regard 
demand  as  probabilistic.  Although  the  demand  probability 
distribution  may  be  known  to  change  such  as  in  seasonal 
fluctuations  or  long-term  trends,  the  state  of  methodology 
in  stochastic  processes  for  inventory  control  requires 
the  assumption  that  demand  is  identically  distributed 
in  the  time  periods.  Eecause  of  this  restriction,  the 
deterministic  case  is  sometimes  a  better  approximation 
for  demand  when  it  is  rapidly  changing  over  time  (i.e.  the 
deterministic  case  fixes  demand  in  the  various  time 
periods  according  to  some  previous  knowledge  of  its 
behavior) o 

Another  way  of  looking  at  the  aforementioned 

probabilistic  case  is  to  allow  the  size  of  each  demand 

\ 

to  be  a  random  variable,.  Consequently,  this  is  a  con¬ 
tinuous  time  stochastic  process  which  is  more  appropriate 
when  orders  can  be  placed  at  any  moment  of  time.  For 


6 


application  of  this  concept,  the  assumption  is  made  that 
demands  are  independent  and  identically  distributed  random 
variables. 

When  nothing  is  known  of  demand  one  may  apply 
decision-making  under  uncertainty  as  developed  by  Wald 
[3]  which  involves  both  estimation  and  decision-making 
as  successive  observations  of  demand  are  taken,  a  com¬ 
plicated  sequential  decision  problem.  Y.  Fukuda  provides 
a  qualitative  approach  to  this  solution  N- 
Co  Lag  Time. 

There  are  three  cases  of  lag  time  to  consider. 

In  this  thesis  the  time  between  order  and  delivery  is 
assumed  to  be  zero  in  order  not  to  over-complicate  the 
computational  techniques  to  be  displayed;  however  the 

4 

extension  of  this  model  to  the  case  of  fixed*  lag  time 
between  order  and  delivery  is  presented  by  Karlin  and 
Scarf  [i]  and  has  the  same  characteristics  as  the  dynamic 
inventory  model  with  no  lag  time  when  both  models  assume 
backlogging  (see  subsection  3d).  The  case  where  lag  time 
is  a  random  variable  has  been  treated  by  Scarf  [i]  ( see 
chapter  16). 

It  should  be  noted  that  when  demand  is  deter¬ 
ministic,  the  consideration  of  fixed  lag  time  is  in- 

\  ♦ 

consequential  since  we  could  order  sufficiently  in 
advance  to  cover  the  known  demands.  In  all  cases  the 
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lag  time  directly  affects  the  amount  of  stock  held 
(i.e.  an  increase  in  inventory  to  protect  against  short¬ 
ages  until  deliveries  arrive).  There  is  onepractical 
consideration  in  the  dynamic  model  where  lag  time  is 
a  random  variable  for  which  no  solution  has  been  found 
through  the  dynamic  programming  formulation  at  the 
present  time  and  that  is  the  condition  where  orders 
arrive  out  of  sequences  This  is  referred* to  as  cross 
over*  Remember  that  order  quantity  is  a  random  variable, 
do  Backloggings 

When  demand  for  an  item  exceeds  supply,  then 

the  policymaker  may  do  one  of  several  things:  (i)  make 

a  premium  order  thereby  taking  a  penalty  in  the  amount 

of  the  premium  costs,  (ii)  do  nothing  and  allow  the 

customer  to  go  elsewhere  for  satisfaction  thereby  taking 

a  penalty  in  customer  goodwill,  (iii)  backlog  the  order 

awaiting  arrival  of  orders  to  satisfy  the  unfilled  demand 

thereby  taking  a  penalty  that  may  relate  to  both  customer 

goodwill  and/or  increased  ordering  costs.  In  this  case 

* 

a  negative  inventory  becomes  meaningfulo 
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Methods  of  Solution  Available* 

At  this  juncture  there  exists  a  stochastic  process 
based  on  the  (s,S)  type  policy  which  may  now  be  treated 
in  one  of  two  ways* 

a.  First  Way0 

The  first  way  consists  of  viewing  the  transient 
behavior  of  the  stochastic  process  through  n-periods 
or  an  infinite  number  of  periods.  This  essentially  is  the 
original  approach  used  by  Arrow,  Harris,  and  Marschak 
^9]  in  setting  up  the  loss  function  for  a  general 
period  t,  then  summing  the  expected  losses  over  a  given 
time  horizon  with  respect  to  the  random  variable  of 
stock  levelo  The  distribution  of  stock  level  is  deduced 
through  a  functional  relation  with  the  random  variable 
of  demand.  This  method  will  be  outlined  in  section  5  where 
it  will  be  pushed  to  an  approximate  solution  through  use 
of  an  integral  equation  of  renewal  theory  [l]#  [^]° 

b.  Second  Way. 

The  second  method  of  treatment  deals  with  the 
stationary  phenomena  of  the  process,  If  yn  represents 
the  stock  level  at  time  n,  then  subject  to  mild  stabil¬ 
ity  nequirements  it  can  be  shown  £lj(refer  to,.-  pages 
23l|-237  and  pages  292-297)  that  yn  possesses  the  so- 
called  ergodic  property  (i.e.  the  distribution  function 
for  y^  converges  to  a  limiting  distribution  function) 
when  the  optimal  policy  is  of  the  (s,S)  type.  Thus  the 
limiting  or  stationary  distribution  is  a  function  of 
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the  policy  and  the  demand  distribution,  and  it  is  in¬ 
dependent  of  the  initial  stock  level.  The  beauty  of  this 
method  is  that  the  cost  functions  have  not  entered  into 
the  problem  up  to  this  point.  Using  the  loss  function 
representation  for  a  general  period  n,  denoted  /£(yn), 
and  dropping  the  dependence  on  n,  the  expected  value 
of  J^y)  with  respect  to  the  stationary  density  yields 
the  equilibrium  average  loss,  denoted  as  follows: 


i 


CD 


y)  g(y)  dy 


where  g(y)  denotes  the  stationary  distribution  for  the 
stock  level. 

The  stationary  distributions  discussed  in  subsection 
2b  can  be  found  through  the  application  of  renewal  theory 
£lj(refer  tp^  chapter  15)  or  through  the  application  of 
differential  equations  £  1  j(refer<- Jto,  chapter  11+ )  when 
the  demand  distribution  function  is  a  member  of  the 
Gamma  family  of  distributions 0 


Sp  Original  Method  of  Solution* 

It  is  proposed  that  the  original  Arrow,  Harris, 
and  Marschak  dynamic  model  be  solved  for  the  optimal 
values  of  (s,S)  where  the  demand  density  function  is 
specified  as  f(£  )  =0”^  •  The  detailed  computations 
are  straightforward  and  can  be  found  in  Appendix  I.  The 
rule  of  action  for  time  period  t  with  y^  as  the  stock 
level,  Xj.  as  the  stock  level  including  replenishment , 
and  as  the  demand  are  represented  both  analytically 

and  graphically  as  follows: 


If  yt>s,  then  zt=0  (and  x^=yt ) 

If  —  then  z^=S-yt  (and  x^=S ) 


functions  defined  as  follows: 


c  (  0  )  =  K 

p(°)  =  p 
h(»)  =  hxyt 


Under  an  (s,S)  policy  with  the  initial  stock  position, 
y  ,  specified,  there  is  a  Markov  process  on  the  sequence 
of  values  for  the  stock  level.  The  loss,  in  any 

period  (t,  t+l)  depends  on  the  stock  level,  y  ,  at  the 
beginning  of  the  period,  the  cost  functions,  and  the 
demand  distribution  function,  F(£): 


(5U) 


!(y  ,  fhxyt  *  p[1*p(yt)]  for  a<7t- 

*  |  h*S  +  p  [  l-F(S)]  for  yt-£ 


An  important  feature  of  the  function  £(yt),  which  wiTT- 
be  used  later  in  finding  the  optimal  (s,S)  values,  is 
that  the  function  involves  s  and  S  as  parameters  and 
is  constant  with  respect  to  y^^s;  thus  £(0)  -  J^S)  =  K* 
Consider  L(yQ)  as  the  minimum  discounted  expected  loss 

which  will  be  incurred  during  an  infinite  time  period  if 

/ 

j0  is  the  initial  stock  level  and  an  optimal  ordering  rule 

)  , 

is  used  throughout  this  infinite  time  period,.  If  an  order 
at  the  first  stage  brings  the  stock  level  up  to  ap  Amount 
y  and  an  optimal  ordering  policy  is  followed  in  the 

I 

second  stage  onward,  then  the  expected  loss  from  the 
second  stage  onward  discounted  to  the  present  is: 


if  y  —  s 


(5o2) 


OC  |  J~  L(S-{)  dP{  £  )+L(sO)J\-F(S) 


L(y-£)  dF(£  )+L(0)  |l-F(y)l  If  y 


>  s 


Consequently,  the  minimum  expected  loss  is  achieved  by 
the  policy  that  minimizes  the  sum  of  the  expected  loss 
for  the  first  period  and  the  discounted  minimum  expected 
losses  in  the  future: 

(5o3)  L(y)=  l(j)+OC  /  L(S-£  )  dF(f  )+<XL(0)[l-F(S)] 

if  y^s 

(5.U)  L(y)=  X(y)  +  CX  T  L(y-£)  dF(  £  )+0(L(  0)  [l-F(y)] 

Jn~ 

U  if  y>3 

These  are  the  same  functional  equations  (ij-.H)  and  (U*l  ) 
of  showing  the  recursive  properties  of  the  dynamic 

model.  The  lower  limit  of  integration  is  set  at  0-  iri 

order  to  insure  that  the  random  variable  for  demand,  £ , 

*  '  1 

'does  not  have  a  positive  probability  at  t  =0,  and,  tber«- 

V  /> 


by,  avoid  a  discontinuity  in  the  Stieltjes  integral 


\ 


1 


The  exposition  in  this  section  could  be  shown  for  the 

V 

case  in  which  the  demand  distribution  is  discrete  and 
all  functions  are  defined  on  integer  values;  the  integrals 
would  be  replaced  by  appropriate  summations.  « 
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It  was  noted  earlier  in  equation  (5.1)  that  £( y) 
is  independent  of  y  for  0^y^so  Note  in  equation 
(5.3)  that  L(y)  is  independent  of  y  for  0  —  y—  s0 
Putting  y=0  in  (5.3)  and  y=S  in  (5*4),  then  subtracting 
the  latter  from  the  former  produces: 

(5.5)  L(0)  -  L(S)  =  i(o)  -i(S)  =  K 


Equation  (5»4)  can  be  solved  for  the  function  L(y)  by 
eonsidering  L(0)  as  an  unknown  parameter,  then  (5*5) 
can  be  used  to  find  L(0)»  But  before  this  solving  takes 
place,  (5*4)  is  changed  into  the  usual  form  of  the 
integral  equation  of  renewal  theory  whose  solution  is 
found  in  terms  of  L  and  ji •  It  is  this  solution  that  is 
used  to  find  L(0).  Substitutions,  change  of  variable,  and 
renewal  summation  of  convolutions  for  demand  provide  the 
means  for  finding  a  solution  [5]o 

The  steps  begin  by  breaking-/up  the  integral  on  the 
right  side  of  (5«U)J 


f  L(y-£)dF (£)=f  L(y-£  )  dF(£  )+f  L(y-£)dF(£ 

Jo  Jo  J  y-s 

ry‘a  rJ 

=  I  L(y-  £)dF(  £  )+L(0)  /  dF(£) 

Jo  Jy— 


In  the  last  term  L(0)  =  L(y-s).  Substitute  this 


into  (5»4)»  then  in  the  next  step  substitute  7]  =  y-s  and 
L(y )  =  L(7J+s)  =  A(7])- 


ry‘s  r 

(5*14-) '  L(y)=£(y)+a/  L(y-  £  )  dF(£)+(XL(0)/  dF(£  )+Oa(0)  [  i-P(y )] 

Jo  Jy-s 

ACT|)=i(7]+s)+ar  A(7?-f)dF(£)  +  aL(0)^F(y)-F(/|)  +  [l-P(y)]| 

„  fn 

AC7|)=i(7]+s)  +  a/  A(7?-£)dP(f)+aL(0)[l-P(/])]  for  7]  >0 


This  is  the  integral  equation  of  renewal  theory.  The  n-fold 
convolution  of  the  distribution  of  demand  is  F  (£)  which 
is  used  in  the  solution  of  (5»U)  as  follows: 


00 

(5.6)  Ha(f)  -£  an  V£) 

n=l 

where  the  convolutions  are  defined  as  follows: 


=  p<£) 


P 

n 


n-1 


(£-u)dP(u) 


for  n=2,  3,  *  •  • 


The  solution  to  (5»U)  in  terms  >.pf  L  and  is  shown  on 
page  33  of  [5]‘.  -  ' 
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(5.8)  L ( 0 )  = 


(i-a)[i+Ha(s-s>] 


As  pointed-out  on  page  3U  of  [5]»  the  determination  of  the 
optimal  policy  which  minimizes  L(0)  is  tantamount  to  find¬ 
ing  the  optimal  policy  that  minimizes  L(yQ)  provided  that 
the  optimal  value  of  s  is  greater  than  zero0  The  finding 


of  the  optimal  (s,S)  policy  required  that  the  system  of 

* 

-mrL(O)  =  0  be  solved  in  term! 

m 

,L(0)  must  be  positive  for  the 


equations  r— -L(0)  =  0  and  rrL(O)  =  0  be  solved  in  terms 

as 

of  S  and  =  S— s«  Also  ^^2 


minimum  to  exist.  The  appropriate  equations  are: 


-S-s 


(5.9)  |jL(0)=h-pxf  (S)+/  [h-pxf(S-£)]dHC((^)  =  0 


-S-s 


.1 


|^L(0)=h(S-s)-p[f  (S)-P(s)]  +K+ I  [h-pxf  (S-£)] 


■i 


It  is  assumed  that  Hq^(^)  =  J  h^(t)  dt0 
One  can  find  for  many  demand  density  functions 

which  have  practical  application  to  actual  demand  behav¬ 
ior,,  However,  solving  (5.9)  for  the  optimal  (s,S)  values 
may  require  numerical  methods,, 

The  other  alternative  to  this  method  is  a  simulation 


I 
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o 


CO 


of  (5»8)  using  predetermined  functions  of  dH^(£) 

For  some  guidelines  on  the  number  of  runs  necessary  for  a 
95%  confidence  level,  see  Geisler  £  2 j#  An  attempt  was  made 
to  set-up  this  simulation  on  the  CDC  1604  computer  using 
FORTRAN  machine  language;  however,  unfamiliarity  with 
FORTRAN  caused  the  effort  to  be  time  consuming  both  in 
preparation  of  the  program  and  in  debuggingo  It  is  suggested 
that  the  next  undertaking  of  this  problem  begin  very  early 
in  the  learning  phase  of  programming  and  that  another 
machine  language,  such  as  SCRAP,  be  investigated  for  better 
adaptability  of  this  problem* 

As  foretold  in  section  1  the  equation  is  now  trans- 
formed  to  a  stationary  cost* equation  which  implies  that 
the  loss  in  period  t,  J^.,  approaches  a  limiting  value 
JL  as  t-*-oo  and  is  independent  of  y#,  the  initial  stock 
level.  By  use  of  a  standard  Abelian  theorem  £  10 ]  and  as 
heuristically  outlined  on  pages  37-38  of  [5]»  the  right 
side 'of  equation  (5«8)  may  be  multiplied  by  (1-00  >  and 

letting  CK-*- 1  as  suggested  by  Him.  (l-CX)L(O)  ^  the 

CX~+~1 

stationary  loss  equation  is  obtained: 

•  S-s 


K 


ico  = 


+  £(s)  ♦  j  l( s-£  )  dH(£  ) 

J 0 


1  +  H(S-s) 


solution  using  demand  density  function  f(  £  )  =  0"^  will 


,a-L 
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be  found  so  that  a  comparison  can  be  made  with  the 
solution  in  section  60  On  page  39  of  demand  den¬ 

sities  of  the  type 


(where  k  is  an  integer)  are  shown  to  give  the  following 
results : 


H 


a 


-£u 


£ 


U*  € 


JA  0 
a  JB  u 


du 


The  gamma  type  density  function  is  chosen  since  the  product 

of  the  characteristic  function  n-times  yields  another 

gamma  density  with  parameters  nk  and  j$  (the  sum  or 

addition  of  n  independent  identical  random  variables 

is  the  product  of  the  characteristic  function  n-times. )»  Here 

±_ 

^2*  . .  '  ^k  ar®  tlie  roots  of  unity. 

Por  f(£)  =  £  ^  ,  the  parameters  are  k=l  and  =1 

(thus  isj^  =1).  Since  (X=l,  then 


l  - 

^OO  - 


K  +  hS  +  p  C"3  +  ih(S^-s^) 


l  -4-  s-s 
18 


As  shown  in  Appendix  I  for  fixed  A  =  S-s,  the  minimum 


occurs  at 


S  =  fin - Av(1+A)  +  A 

h 


s  =  fin. - fin(l+A) 

h 

However,  it  is  useful  for  comparison  with  other  methods 
of  solution  to  find  the  optimal  value  of  A  o  From 
Appendix  I, 

A  = 

_s  h  +  V  2Kh 

e  ‘  = - 

p 


which  will  turn  cut  to  be  the  same  solution  in  section  6 
wherein  the  stationary  distribution  for  stock  level  was 
used  • 
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6.  Solution  Using  Stationary  Distributions  of  Stock  Level0 
As  noted  in  chapter  15  of  [l]»  ^co =  Q(™i  ( ^-~OC  )  L(y ) 
may  be  also  determined  by  finding  the  stationary  distri¬ 
bution  of  the  stock  level  and  afterwards  calculating  the 
costs  for  a  single  stage  problem  where  the  stock  level 
is  a  random  variable  having  the  stationary  distribution. 

The  stationary  distribution  may  be  obtained  for  a  general 
demand  density  function  f(  £)  and  is  composed  of  two 
sections.  For  stock  level,  y,  in  the  range  £s,sj, 

co 

(6.1)  g(y)  =  C  ^  Fn(S-y)  for  s^y^S 

n=l 


The  constant  C  is  determined  by  the  appropriate  boundary 

conditions  and  F  is  the  n-fold  convolution  of  the  demand 

n 

distribution  function  (cf,  equation  5*6) a  The  stationary 
density  function  for  y<s  is  a  multiple  of  the  so-called 
excess  distribution  for  the  renewal  process  of  independent 
random  variables  Although  (6,1)  may  be  difficult  to 

find,  the  distribution  for  the  excess  variable  is  more 
readily  obtained  by  use  of  Laplace  transforms0  The 
excess  variable  can  be  characterized  as 


+  C  _  +  ©••••<>••• 

where  v(y)  is  a  random  variable 
integer  from  the  set  (0, 1,2,3, 


f. 


Jy)n 


-  (S-s) 


t<r 

<s- 


S-s 


whose  tfalue  may  be  an 
. )  satisfying  the 

\' 

|\ 
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following  inequalities: 


+  £  ,  <  S-s 

v(y) 

+  £  ,  -  S-s 

b v(y)+l 


Letting 


0  -  f  +  f  „  ■ 

*v(7)  S1  *2 


+  £  and 

^v(y) 


f 


v(y)+l 


the  excess  variable  of  y  may  be  pictured  as  follows 


Z 


S-s 


0. 


v(y) 


S-s 


<t>  ,  s  1 

^v(y)+l 


Excess  Variable  of  S-s 
Figure  2 


The  renewal  type  equation  follows  from  this  definition  of 


A  renewal  process  is  defined  as  a  stochastic  process 
composed  of  sums  of  positive  identically  distributed  and 
independent  random  variablese  This  much  of  the  theory 
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/ 


is  presented  in  order  to  provide  sane  intuitive  appeal,, 

Those  interested  in  the  detailed  study  of  renewal  processes 
are  referred  to  chapter  15  of  [lj* 

When  the  demand  density  functions  are  members  of  the 
gamma  family,  the  stationary  density  function  of  stock  level 
may  be  derived  alternately  through  the  use  of  differential 
equations  as  in  chapter  ll|  of  [l]»  The  stationary  distri¬ 
bution,  g(y),  for  the  case  where  f(£)  =  0**^is  taken  from  ^lj 
and  is  found  to  be 

1 


g(y)  =< 


1  ♦  s  -  s 

1  p-(s-y) 

1  +  S  -  s 


for  s<y^S 

for  y— s 


The  stationary  loss  is  a  straight  forward  calculation 


4 


where  the  one  period  loss  in  our  case  is  set-down  in  (5»1)  as 


i(y>  =  fhy  +  P!1-'(,)! 

[hS  +  p[  1-F  ( S)J 
Since  F(£)  =  1-0*^  then 


£(y)  = 


hy  «■  p[6*y] 


hS  +  p[6~S]  +  K 
Sinde  *our  model  allows  backlogging. 


for  s  <ry  f£S 
for  y— s 

for  s<y^S 
for  y  —  s 

negative  stock  levels 


22 


may  exist 9  and  then 


U  =  f  (hS+peS-*-K)— - -  0"(s“y)dy+  f  (hy-*-pe’y)— -  dy 

05  /  1+S-s  J  l+S-s 

oo  "'s 

K  +  hS  +  P0S  +  sh(S2-s2) 

1  4*  S  -  M 

This  is  the  same  stationary  cost  function  as  (5*10),  and 
the  solutions  are  the  same. 
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7.  The  Simulation  Problem. 

^The  great  advantage  in  the  use  of  renewal  theory  is 
that  the  cost  functions  enter  separately  into  the  solution 
and  in  addition  they  enter  into  a  simple  expected  value 
form  with  respect  to  the  stationary  density  of  stock  level. 
Thus  the  cost'  functions  may  be  more  complicated  without 

i 

i 

unduly  burdening  the  solution.  This  approach  also  provides 

* 

\ 

a  more  flexible  method  for  simulation  wherein  the  program 

\ 

will  not  be  'tited  down  to  a  specific  set  of  cost  functions 
as  would  be  the  case  in  a  simulation  of  the  equation  for 

L(0),  pointed  put  earlier  in  section  5. 

1  r  « 

Geisler’3  jreport  |_2J  provides  a  statistical  evaluation 

1 

of  the  sample  sjize  required  for  a  desired  level  of  precision 
for  estimating'  shortages  and  overages  (i.e.  stock  level 
above  zero)  in  the  AHM  dynamic  model  for  both  lag  and  no 
lag  in  delivery  with  linear  penalty  and  holding  cost  and  or- 

4 

*  dering  cost,  K  +  c»z.  The  precision  represents  a  way  of 
finding  sample  size  when  the  mean' number  of  shortages  or 
overages  is  within  K.%  of  the  trqe  value  with  95%  confidence. 
Part  D  of  Geisler’s  report  has  sections  III  and  IV  which 

A 

analyze  the  eiven  model  by  inventory  cycles  and  by  tim« 
periods, respectively .  The  time  period  model  is  what  has 

‘V«.  ♦ 

been  discussed  in  this  thesis.  The  inventory  cycle  is  the 

number  of  periods  between  reorder  where  the  number  of 

1  ' 

periods  is  a  random  variable.  The  concepts  in  renewal  theory 


2b 


are  covered  in  chapter  15  of  [i].  sections  III  and  IVC 

Sections  III  and  IV  outline  the  analytic  solutions. 
Subsection  III-3 .b  shows  the  specific  expected  costs  with 
respect  to  the  stationary  density  of  stock  level  when 
f(£)  =\e  ^  In  subsection  IV-2,  the  expected  values  of 
shortage  level,  stock  level  (overage),  and  reorder  quanti¬ 
ty  per  period  are  given  on  pages  79,  85,  and  89  respec¬ 
tively.  To  get  the  stationary  loss  (cost)  multiply, 

respectively  by  p,  h,  and  c.  To  the  reorder  cost  -i-.c 

K.  ^ 

must  be  added  — r-i — r~rr  •  Consequently  Geisler's  report  has 

Ml+XA) 

provided  an  exercise  reference  in  the  study  of  renewal 
theory  and  its  utilization  in  finding  an  analytic  solution 
to  the  AHM  dynamic  model  with  less  restrictive  cost  functions. 
When  the  stationary  costs  have  been  derived,  either  directly 

or  by  use  of  numerical  methods,  a  simulation  can  be  under- 

\ 

taken  to  find  the  optimal  (s,S)  policy  which  minimizes  the 

stationary  loss  function.  Section  V  of  part  D  can  be  used 

\ 

in  the  simulation  to  determine  sample  sizes. 

\ 

\ 

\ 

\ 

\ 

l  \ 

\ 


25 


BIBLIOGRAPHY 


1.  K.  Arrow,  S.  Karlin,  and  H, 'Scarf,  Studies  in  the 
Mathematical  Theory  of  Inventory  and  Production, 

Stanford  University  Press,  195$» 

2 .  M.  A.  Geisler,  Some  Statistical  Properties  of 
Simulation  Models  Used  in  Studying  Inventory  Problems, 
Technical  Report  No.  73  of  the  ApplieSd  Mathematics 
and  Statistics  Laboratories  at  Stanford  University, 
December  29,  1991. 

| 

3.  A.  Wald,  Statistical  Decision  Functions,  John  Wiley 
&  Son,  Inc,,  1950. 

I4.,  Y.  Fukuda,  Bayes  and  Maximum?  Likelihood  Policies  for 
a  Multi-Echelon  Inventory  Problem,  PRO  Report  161 
of  the  Planning  Research  Corp.  of  Los  'Angeles, 

17  June  I960.  1  \ 

5.  K.  Arrow,  T.  Harris,  and  J.  Marschtfk,  qptimal  Inven¬ 
tory  Policy,  Rand  Corp,.  Report  p-l8§,  p.6  November  1950© 

6.  R.  Bellman,  Dynamic  Programming,  Princeton  University 
Press,  1957. 

7.  W.  Feller,  On  the  Integral  Equation  of  Renewal  Theory, 
Annals  of  Mathematical  Statistics,  XII  (I9i|l), 

pg.  21)3-66.  j  \ 

8.  H.  Scarf,  The  Optimality  of  (s,S)  Policie's  in  the 
Dynamic  Inventory  Problem,  Technical  RApoi^t  #11  dated 
April  10,  1959  from  the  Applied  Mathematic^  and 

Statistics  Laboratory  of  Stanford  University. 

\ 

Y 

9.  K.  Arrow,  T.  Harris,  and  J.  Marschak,  Optimal  Inventory 
Policy,  Econometrica,  Vol.  XIX  (195D,  p|p.  2$ 0-72. 

10.  D.  Widder,  The  Laplace  Transform,  Princeion  UniYersity 
Press,  19^1. 


2$ 


APPENDIX  I 


9.  Computations  for  the  Original  AHM  Solution  of  Section  $0 
Starting  with  the  case  where  f(£)=0~^  *  the  values 
of  (s,S)  in  functional  form  will  be  found  that  minimize 


Let 


K+hSO  p0*s  +|h(S2-s2) 


lo**- - 

1+S-s 

A  =S-sa 

®  as 

(1+S-s)  (h+hS)-  [K<»KS+p  e”*^  ih(S2-s2)] 

(lOS-s)2 

(1+S-s) (-p0 S-hs)-^K+hS+pe  +^h(S2-s2)]  (-1) 

(1+S-s)2 

<D  »  h+h  A+hS+hS  A  -K-hS-p£f 8  -|Ah(.S+s)  *  0 
h+hA+iAh(S-s)-K-pe*S  =0 
-K-pe“S+h+Ah+i  A2^  =  0 

l 

0  t  -p0a-Ape"S-hs-Ahs+K+hS+pe’S+l3  AhS-^-Ahs  *  o 
-Ape~S+h(s-»)+iAhS-|Ahs+K  =  0 
-K  =  -Ape  S+hA+iAh(S-s) 

-k  *  -Ap6*’s+hA+ih  A2 

Substituting  0)  »  into  (t)  •  for  -K  : 

(-Ape"a-*-hA+ih  A2)-pe"a+h+hA+ifc  A2  =  o 

-Pe‘S(l+A)+h(  A2+2A+1)  =0 

pe"s(i+A)  -  fcU+A)2 
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P  -3  . 

—  e  =  1  +  A 

h 


e5  * 


h(l+A) 


a*  =  jjt —  -  in,  (1+A) 

h 

s*  =  fct—  -  L  U+A)  +  A 

h 


45*  ,»* 

a  and  S  denote 
optimal  values 


These  results  agree  with  page  40  of  £5]  where  A  ^as  a 
fixed  value*  In  order  to  solve  explicitly  for  A,  a 
mathematical  device  must  be  usedo  This  device  consists 
of  removing  the  variable  h  by  taking  the  loss  function 
with  respect  to  h  after  certain  substitutions  into 
Substitute  the  following  into 


pe3  =  Mi+A*> 


.45* 


=  L- 


h(l+A*> 

i*  =  JL — - —  +  A" 
h(l+ A*) 


icc  = 


K+h  f  J L - ♦A*  +h  ( 1+  A* )  +ih  A*  [2  j L 

L  h(l+A*)  J  L 

i+A* 


h(l+  A*) 


A" 


K+h 


l  _ 
^00  ~ 


i  A*+2  A*+i 


+h(  1+ 


A*) 


1+A* 


1  +  A* 
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+  1«  X 


h  A*2 +2  A*+i 

“7^'T 


♦  J^p"  -  Jfcd+ A*) 


K 


P 


where  K"  = —  and  p"  =  - —  •  A  check  of  the  consistency  in  the 

h  h 

units  of  the  equation  shows  that  1*  =  (one  charge-unit/period) 
*  (storage  cost/unit-period ) (no ♦  of  units  stored,  averaged) 0 
In  the  first  term  the  order  handling  charge  is  divided 
equally  among  the  number  of  units  in  the  dynamic  range  of 
+1*  The  third  term  is  the  penalty  premium  expressed  in 
(1*  units x  1  Unit)  and  averagedo  This  analysis  of  consist¬ 
ency  helps  verify  the  propriety  of  the  substitutions©  Now 
minimize  with  respect  to  £  : 


-K"+  A  + 


-K»  (i+A*)(2+A*)-(£  A*g  + 

(i+A*)2  +  u+A*)2 

[A*+  +3  A*  *2  A*2-2A*-i]-i  +  A 


+2  a*+D  i+A* 


J'.  .  W, 

To  set  the  (s  ,S‘)  values  after  is  determined,  an 

equations  for  s*  is  used: 


pg'J  =  h(l+A"> 


This  completes  the  analysis. 
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